Remote Dynamic Three-Dimensional Scene Reconstruction
نویسندگان
چکیده
Remote dynamic three-dimensional (3D) scene reconstruction renders the motion structure of a 3D scene remotely by means of both the color video and the corresponding depth maps. It has shown a great potential for telepresence applications like remote monitoring and remote medical imaging. Under this circumstance, video-rate and high resolution are two crucial characteristics for building a good depth map, which however mutually contradict during the depth sensor capturing. Therefore, recent works prefer to only transmit the high-resolution color video to the terminal side, and subsequently the scene depth is reconstructed by estimating the motion vectors from the video, typically using the propagation based methods towards a video-rate depth reconstruction. However, in most of the remote transmission systems, only the compressed color video stream is available. As a result, color video restored from the streams has quality losses, and thus the extracted motion vectors are inaccurate for depth reconstruction. In this paper, we propose a precise and robust scheme for dynamic 3D scene reconstruction by using the compressed color video stream and their inaccurate motion vectors. Our method rectifies the inaccurate motion vectors by analyzing and compensating their quality losses, motion vector absence in spatial prediction, and dislocation in near-boundary region. This rectification ensures the depth maps can be compensated in both video-rate and high resolution at the terminal side towards reducing the system consumption on both the compression and transmission. Our experiments validate that the proposed scheme is robust for depth map and dynamic scene reconstruction on long propagation distance, even with high compression ratio, outperforming the benchmark approaches with at least 3.3950 dB quality gains for remote applications.
منابع مشابه
Airborne Downward Looking Sparse Linear Array 3-D SAR Heterogeneous Parallel Simulation
The airborne downward looking sparse linear array three dimensional synthetic aperture radar (DLSLA 3-D SAR) operates nadir observation with the along-track synthetic aperture formulated by platform movement and the cross-track synthetic aperture formulated by physical sparse linear array. Considering the lack of DLSLA 3-D SAR data in the current preliminary study stage, it is very important an...
متن کاملThree dimensional scene reconstruction from passive imagery
This paper describes a new approach, developed under the auspices of the Electro Magnetic Remote Sensing Defence Technology Centre, for reconstruction of three dimensional scene content using passive video. This gradient based scheme uses the parallax in an image sequence to estimate the distance from sensor to scene. Intensity measurements from a passive camera are combined with a rigid body m...
متن کامل3D Scene Reconstruction System from Multiple Synchronized Video Images
One of the goals of three-dimensional (3D) computer graphics is to create virtual realistic images of dynamically changing scenes. In this paper, we designed and implemented a system that processes multiple synchronized video sequences and generates 3D rendering of dynamic objects in real time. The videoimage-based virtual volumetric scene reconstruction system acquires synchronized multiple vi...
متن کاملEnergy Analysis of Road Accidents Based on Close-Range Photogrammetry
This paper presents an efficient and low-cost approach for energy analysis of road accidents using images obtained using consumer-grade digital cameras and smartphones. The developed method could be used by security forces in order to improve the qualitative and quantitative analysis of traffic accidents. This role of the security forces is crucial to settle arguments; consequently, the remote ...
متن کاملPeriscopic stereo and large-scale scene reconstruction
The capture of three dimensional structure from two dimensional images has received considerable attention in computer vision. Existing work has concentrated on use of stereo camera systems and the reconstruction of small objects. Recently, single cameras in motion have been used to capture sections of scenery which are subsequently reconstructed by skilled technicians with a selection of compu...
متن کامل